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(S/NF/SS-2) EVALUATION PROCEDURES; 

1. (S/NF/SS-2) Operational Phase: 

(S/NF/SS-2) The Project Manager will assess the value of the operational 
phase of the SUN STREAK program by requiring all data consumers (i.e., 
operational task originators) to furnish him with data accuracy and data 
utility assessments. Table 1 illustrates the general format and 
assessment scale (0-3) for this evaluation. Specific data categories may 
vary depending on the nature of the task or on specific objectives; 
however, the overall approach will remain the same. 

(S/NF/SS-2) The Project Manager will enter results of the accuracy and 
utility assessment into the project data base. He will make periodic 
reviews (quarterly) of this data to assess overall effectiveness. 

(S/NF/SS-2) The Project Manager, in coordination with the task 
originators and the Intelligence Community Task Coordinating Group, will 
develop an additional measure of program value. This measurement 
(overall program value) is designed to measure the net worth or total 
contribution of the task in relation to other tasks and to the overall 
intelligence mission. Data accuracy and utility may be high for a 
particular consumer, but the results may not have a significant overall 
impact. This program value scale is similar to the utility scale; 
however it is based on specific measures of over-all benefit. This value 
scale is as follows: * 

Program Value Scale 

0 - Little or no over-all program value. 

1 - Some program value (e.g., helped refine estimates). 

2 - Moderate value (e.g., identified new data, narrowed down 
possibilities). 

3 - High value (e.g., led to significant cost savings, 
identified critical high priority S&T or operational activities). 

4 - Exceptional value (e.g., predicted major 
events/activities, located lost/missing resources or personnel). 

The value evaluation will be used in conjunction with other program 
evaluation parameters (accuracy, utility) for determining program accom- 
plishments and for defining future program directions. 
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'll) For the sunonary evaluation, please check the following boxes as to the accuracy of the submitted material 
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2. (S/NF/SS-2) Training and Operational Qualifying Phase ^ 

lr \ Thprp , re tw0 0 ther aspects of this program that will require evalu- 
inonbv the Project Manager or by his representative; the basic training 
phase and the operationaMual ifying (or operational training) phase. 

(S/NF/SS-2) The basic training phase consists of a large variety of 
easv-to-verify training tasks that are designed for various stages of 
proficiency. Overall evaluations will be based on the accuracy scale 
Esed for operational projects and on an additional q " a ^ 1 ‘* t ,^, vidual . s 

training ItEges. The quantitative proced ure 

M p conceDt/element analysis) will allow assessments of degree o 
accuracy and P will provide the basis for determining what general classes 
of operational projects a viewer can best perform. 

(S/NF/SS-2) The operational qualifying phase follows satisfactory 

projects! ^at^fronTthis^^ identify tKsi°types of 

operational tasks for remote viewing (RV) applications. 

ic, kif ?\ Farh RV source will perform several hundred operational 
LaWv^q tasks per yZ These tasks will include representative 

operational reliability and utility will be made US1I !J 9 quantitative 

lTEE^^^E^?!r^u??r^^sEvTE r sE 

management system for storing large amounts of information and for 
performing appropriate analyses. 

/q/nf/ss Tt is anticipated that a limited operational capability will 

the proposed task and on capability levels of available RV sources. 
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6. Operational Activity (U): 

a. Tasking (U) : 

% 

(S/NF/WN) All operational tasks will be reviewed and prioritized by 
DIA/DT. These tasks can originate from DIA/DT and from elsewhere within the 
Intelligence comnunlty or from other potential users. Although the methanl sm 
for generating/receiving potential tasks from users has not yet been 
finalized. It Is anticipated that the Intelligence Community Task Coordinating 
Group may serve this role. These potential tasks would then be transmitted to 
DIA/DT for disposition. 

(S/NF) There Is an Important condition for accepting potential 
operational tasks: It Is that feedback data must be provided to DIA/DT so 

that adequate evaluation of results can be performed. For sensitive projects, 
special caveats and controls will be established. This procedure will assure 
the user comnunlty that details of the sensitive task will only be divulged to 
those who have the need to know. 

b. Performing Operational Tasks (U): 

(1) Task Management (U): 

(S/NF) To facilitate optlnum accomplishment of all routine and quick 
reaction operational tasks, DIA/DT will establish a detailed procedure to 
Insure that all operational needs can be Immediately resolved and Implemented. 

Activities/functions addressed would Include: 

- 24 hr. availability of management approval authority 

Approved For Relefed#»2®Dttf0W'^:)CIA-RDP96-00789R003800020001-8 
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- 24 hr. availability of people who can perform 
operational tasks (viewers. Interviewers); 

- Resource allocation authority (people required, 
specific assignments, travel); 

- Procedures for Interface with the user community (for 
Intelligence and outside); 

- Procedures for Interface with others (i.e., VO, HUMINT 
Committee); 

- Methods/procedures for transmitting RV data to users 

(I.e., special courier); 

- Procedures for preliminary evaluation of data and 
decision-making for follow-on actions; 

- Procedures for maintaining security controls, and 
safeguarding viewer Identity; 

These and others would be constantly refined to Improve over-all 
responsiveness and effectiveness of operational activities. 
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(2) (S/MF/WN) Methodology : A consistent and scientlftcally-valld approach to 
methods and procedures for active conduct of operational sessions will be 
developed. These will be established as firm project requl rements , and any 
exception (Ue., due to error, unforseen circumstances) will be clearly noted. 
The user cownunlty personnel Involved In operational tasks (l.e., as 
observers, or for data analysis) will -be Informed of all methods/ procedures In 
advance of the conduct of any operational task. This Is necessary for 
operational consistency, for data evaluation, and for making decisions on how 
best to apply the RV data. Specific methods/procedures will be developed -for 
each operational task In accordance with the nature of the task (l.e., QRT, 
long-term), type of targeting methods required, and the type of training 
program used for developing the viewers' capability. 


(3) Records (U) : 

(S/KF) Detailed records will be maintained for all RV operational 
sessions. Specific data will Include people Involved, chronology of events, 
data provided to the viewer, targeting methods used, degree of knowledge of 
target Information by those Involved In the session, or any other Issue 
pertinent to performing the session and evaluating the results. All these 
factors will be Identified and clear documentation procedures will be 
established prior to Initiation of any operational project. The actual RV 
data will also be carefully recorded and controlled, and will be entered Into 
the appropriate data base. Data format will Include verbal records (tape 
recordings) as well as raw data (written description, sketches). These 
records will be stored In such a way as to protect Identify of the user and 
the viewers Involved, and will be subject to all other security controls 

est^l^^eWfbar R£l^e^0$OBm r . a £l^ -8 

available to any authorized Individual or project review group as necessar^^ 
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c. Evaluation of Data (U): 

•£> 

(S/NF/WN) A data package with pertinent raw RV data, and a summarized 
version performed by project personnel , will be returned to the task 
originator and the IC Task Coordinating Group via DIA/DT. All session methods 
and conditions will be Included with this data package. The task originator 
will provide an evaluation of the data according to pre-established criteria. 
The originator will return this evaluation to DIA/DT along with sufficient 
background and feed-back data so that the basis of the evaluation can be 
clearly Understood. Any difference of opinion will be discussed with the task 

‘9 

originator and noted In the project records. In cases where evaluation is 
only partial (i.e., for tasks that can't be Immediately evaluated) the file 
will be kept active until such a time when sufficient data becomes available. 
The task originator will also indicate how the data could be (or was) 
utilized, and will describe the impact such data had on resolution of the 
specific problem of interest. Additional data analysis will be performed on 
the raw data In the growing data base to evaluate trends, patterns, 
statistical Implications, operational constraints, reliability/utility, and 
other aspects pertinent to data utllzation. 

d. Reporting of Results (U): 


(S/NF) In addition to data reports provided to the users, over-all 
project reports will also be prepared on a periodic basis. They will contain 
general Information on types of tasks, over-all results, summaries of task 
originator evaluations, statisitics/trends, and other relevant data as 
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required by DIA/DT. These reports *ould not contain sensitive data; however 
such data could be provided separately on a strict need-to-know basis pending 

appropriate data release approval. 

* 

7. Process Flow Chart (U); 


• - (C/NF ) All project procedures and operational activity Identified in 
the section for training '■end for operational projects will be developed in 
detail in a Project Operations Manual . A process flow chart will also be 
prepared. 
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